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Abstract 


One  sided  sequential  tests  for  the  mean  of  an  exponential 
distribution  are  proposed,  and  the  related  confidence  Intervals  are 
computed.  The  tests  behave  like  the  classical  sequential  probability 
ratio  test  when  the  mean  is  small  and  like  a fixed  time  test  when  the 
mean  is  large  and  accurate  estimation  Is  Important. 
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CONFIDENCE  INTERVALS  RELATED  TO  SEOUENTIAL 
TESTS  FOR  THE  EXPONENTIAL  DISTRIBUTION 


1.  Introduction 

An  Important  example  of  hypothesis  testing  for  the  purpose  of 
decision  making  is  the  quality  control  of  industrial  production,  for 
which  the  required  decision  frequently  is  acceptance  or  rejection  of  a 
production  lot.  In  such  cases  sequential  testing  offers  certain 
advantages  over  fixed  sample  size  tests.  Generally  speaking 
sequential  tests  of  the  same  Type  I and  Type  II  error  probabilities 
(producer's  risk  and  consumer's  risk)  require  on  the  average  less  data 
to  reach  a decision  than  their  fixed  sample  counterparts,  and  this 
shorter  (average)  testing  time  is  usually  economically  desirable. 

There  may  be  cases  in  which  one  would  like  to  supplement  the 
decision  provided  by  a test  of  hypothesis  with  a point  or  Interval 
estimate  for  some  parameter.  An  example  is  the  testing  of  a prototype 
with  the  goal  of  deciding  whether  to  start  production  or  to  continue 
development.  In  the  case  that  a decision  to  start  production  is  made, 
it  may  be  advisable  to  have  reliability  estimates  which  are  accurate 
enough  to  permit  subsequent  comparisons  of  the  field  reliability  of 
production  items  with  the  laboratory  reliability  of  the  prototypes. 

In  such  cases  the  advantages  of  sequential  tests  are  not  so  apparent; 
for  the  early  termination  of  a sequential  test,  which  seems  advanta- 
geous from  a decision  making  point  of  view,  may  result  in  insufficient 
data  for  accurate  estimation. 
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The  goal  of  this  note  Is  to  show  by  a concrete  example  that 
sequential  tests  can  be  adapted  to  maintain  some  of  their  advantages 
while  minimizing  their  concomitant  disadvantages  from  the  viewpoint  of 
estimation. 

2.  A sequential  test  and  the  related  confidence  Intervals 

Assume  that  the  times  to  failure  of  nominally  Identical  Items 
form  a sequence  of  Independent  exponentially  distributed 

random  variables  with  mean  time  between  failures  (mean  lifetime)  equal 
to  9.  Suppose  that  to  determine  the  acceptability  of  these  Items  one 
desires  to  test  the  hypothesis  Hq.*  6 ^ 6q  v.s.  6 £ with  some 

prespecified  error  probabilities  a - (Reject  Hq)  and  6 • ^0.0 

(Accept  Hq) • If  Hq  is  rejected,  the  items  are  deemed  unacceptable, 
and  thus  a denotes  the  producer's  risk.  Similarly,  B is  the  consumer’s 
risk.  By  a change  of  scale  It  may  be  assumed  that  6^  • 1 and  Indeed 
will  be  In  the  rest  of  this  note.  To  simplify  the  discussion  It  will 
be  convenient  to  assume  that  one  item  is  put  on  test,  replaced  when  It 
falls  by  a second  Item,  etc.  until  the  test  Is  terminated. 

Let  s - X,  + . . . + x denote  the  time  of  the  n^  failure, 
n 1 n 

The  customary  fixed  time  test  of  against  rejects  if  and  only 
If  for  appropriately  chosen  m^  and  t^  s^  £ t^.  The  test  parameters 
m^  and  t^  are  chosen  to  give  the  desired  values  of  a and  B.  It  is 
sometimes  more  convenient  to  describe  the  test  in  terms  of  X(t),  the 
number  of  failures  prior  to  time  t,  which  is  a Poisson  process  of 
intensity  X - 6~^.  The  rejection  region  is  given  in  terms  of  X(t)  by 
X(tQ)  i ®Q*  Operationally  the  test  is  usually  censored,  l.e.,  one 
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observes  the  process  of  failures  until  the  — failure  or  for  t^ 
units  of  time,  whichever  occurs  first.  Censoring  has  no  effect  on  the 
accept-reject  decision  and  hence  no  effect  on  the  error  probabilities. 

It  does,  however,  mean  that  the  actual  time  on  test  is  a random 
variable  £ t^.  Nevertheless,  the  term  "fixed  time  test"  will  be  used 
to  describe  the  censored  version  in  order  to  dlstlnqulsh  it  easily 
from  the  truly  sequential  tests  described  below.  It  is  important  to 
note  that  the  confidence  intervals  obtained  from  a (censored)  fixed 
time  test  are  not  in  general  the  same  as  from  a true  fixed  time  test 
unless  an  accept  decision  is  reached. 

Suppose  now  that  in  addition  to  testing  one  desires  to  give 
a confidence  interval  for  the  mean  time  between  failures  6 (or 
equivalently  for  the  Poisson  intensity  X) . Suppose  also  that  this 
confidence  interval  is  of  primary  interest  when  is  accepted.  When 
Hq  is  rejected,  further  development  and  testing  will  be  necessary;  so 
it  is  more  important  to  reach  a reject  decision  as  soon  as  possible 
than  to  provide  an  extremely  accurate  estimate. 

The  following  test  of  against  is  designed  to  perform 
like  a sequential  probability  ratio  test  when  is  true  and  early 
termination  is  desired  and  like  a fixed  length  test  when  is  true 
and  accurate  estimation  is  of  primary  concern.  Let  fc(t)  ■ 

X(t)  log(Aj^/AQ)  - (Aj^-X^Jt  be  the  log  likelihood  ratio  for  testing 

the  simple  hypothesis  X - " ^0^^  against  X - Xj(«9^^«l).  Define  ! 

the  stopping  rule  T ■ smallest  value  of  t such  that  ®.(t)  ^ c.  Oiven 
tj,  stop  testing  at  min  (T.t^)  and  reject  if  and  only  if  T £ t^. 

I 

) 
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It  is  convenient  to  put  a - c/log(Xj^/X^)  and  b - - X^) /log(X , 

so  that 

(1)  T ■ smallest  value  of  t such  that  X(t)  ^ a + bt 

(See  Figure  1.)  The  Type  I and  Type  II  error  probabilities  are 
and  P^_^{T>tj^}.  The  parameters  a and  tj^  should  be 
chosen  to  make  these  equal  to  the  desired  a and  S. 


Computation  of  the  error  probabilities  for  this  Lest  is  more 
complicated  than  for  the  customary  fixed  length  test.  A method  vhlch 
gives  adequate  approximations  for  practical  purposes  Is  described  in 
the  Appendix.  The  resulting  approximations  to  the  Type  II  and  Type  I 
error  probabilities  are  respectively 
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a+bt 

(2)  P^{T>t^}  Sp^{9^>t^}  - (X"/X’)  ^ exp{t^(X'/X"- l)}P^,^j^„{8^>t^} 

and 

(3)  Pj^  {T<  t^}  = X^tCb  - Xq)/(1 -b)  - X^b"’-  P^{T  > t^}]  . 

In  equation  (2)  X'  and  X"  are  defined  by 

(4)  X’tj  - a + btj  and  b - (X ' - X") /log(X ' /X")  . 

and  m is  the  smallest  integer  2.  ® "*■  Also  P^^  denotes  probability 

when  the  true  intensity  of  X(t)  is  X,  so  P,{s  > t, } is  the  probability 

Am  1 

2 

that  a X random  variable  with  2m  degrees  of  freedom  exceeds  2Xt^.  To 
attain  given  values  a » P,  {T<t,}  and  6 ” P,{T>t  } using  (2)  and 

Ap  - 1 11 

(3),  first  set  P^fT>tj}  equal  to  the  desired  value  6 on  the  right 
hand  side  of  (3)  and  then  solve  for  a in  terms  of  a and  6.  The  value 
of  tj^  may  easily  be  determined  from  (2)  by  trial  and  error.  Table  1 
compares  two  (censored)  fixed  length  tests  with  the  corresponding 
sequential  tests.  For  both  examples  a " S ■ .10.  The  sequential 
tests  require  on  the  average  about  30  percent  less  testing  time  than 
the  fixed  length  tests  when  X - 1,  and  it  is  desirable  to  minimize 
testing  time.  They  pay  for  this  by  requiring  about  30  percent  more 
maximum  testing  time.  The  maximum  testing  time  is  attained  whenever 
Hq  is  accepted,  and  in  this  case  one  desires  to  have  an  accurate 
estimate  of  X.  The  fact  that  more  time  on  test  generally  leads  to 
more  accurate  estimation  of  X tends  to  minimize  the  disadvantage  of  a 
larger  maximum  test  duration.  Nevertheless,  a modified  sequential 
test  in  which  the  maximum  time  on  test  is  the  same  as  in  the  fixed 
length  test  will  be  described  in  Section  3. 
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TABLE  1 


COMPARISON  OF  (CENSORED)  FIXED  LENGTH  AND  SEQUENTIAL  TESTS 


0q-2(Aq.1/2)  Bq  - 1.5(Aq- 2/3) 


Fixed  Length  Sequential  Fixed  Length  Sequential 


m„  • 14  a 

- 2.86, 

m-  “ 40  a 

- 5.1, 

° b 

- .721, 

° b 

- .822, 

Test 

Parameters 

m 

- 20 

m 

- 58 

to  - 18.9  t^ 

- 23.8, 

to  “ t^ 

- 64.3, 

A’ 

- .842, 

A’ 

- ,901, 

A" 

- .613 

A" 

- .748 

Expected  Testing 

13 

8.9 

36 

25 

Time  When  A ■ 1 

To  compute  confidence  intervals  for  A based  on  observing  X(t) 
for  0 £ t £ mln(T,tj^),  it  is  convenient  to  define  several  auxiliary 
functions.  For  fixed  0 < y £ let 

A^(t)  - sup{A:  P^{T£t}£Y}  t 

A2(n)  - sup{A:  P^{T  > t^^,  X(tj^)£n}£Y}  » 

£j^(t)  - inf{A:  P^{T£t}£Y}  t 

and 

A^Cn)  - inf{A:  Pj^{T<t^}  + Pj^{T  > t^,  X(tj^)  >n}>Y}  • 

It  is  easy  to  see  that  A^  £ ^ (1»1,2).  Moreover,  by  an  argument 
similar  to  that  given  by  Slegmund  (1977)  for  a similar  problem,  it  may 
be  shown  that 
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(5) 


A 


A^(T) 


If  T ^ 

If  T > 


V 

is  a (1-y)  100%  upper  confidence  bound  for  A and 

f 


(6) 


A^(T) 


A = 


If  T < 


I If  T > 

is  a (1-y)  100%  lower  confidence  bound  for  A.  Also  [^,A]  is  a 
(1  - 2y)  100%  confidence  interval. 

Computation  of  the  probabilities  entering  into  the  definitions 
of  \ and  A Involves  the  same  problems  as  computation  of  the  error 
probabilities,  and  is  discussed  in  detail  in  the  Appendix.  For  many 
of  the  cases  of  greatest  Interest,  i.e.,  when  is  accepted,  A and 
^ are  almost  the  same  as  the  customary  confidence  limits  based  on  the 
same  data.  For  example,  suppose  that  the  sequential  test  defined 
above  terminated  at  time  t^^  with  X(tj^)  “ n.  Then  finding  an  upper 
confidence  bound  for  A Involves  computing 


(7) 


P^{T  > t^,  X(t^)  < n} 


P^{X(tj^)<n}  - P^d^tj^,  X(tj)<n} 


If  a fixed  time  test  were  to  lead  to  this  same  data,  the 
appropriate  (1  - y)  100%  upper  confidence  bound  for  A would  be 
A*(X(t^)),  where  A*(n)  - sup{A:  Pp^{X(t^)  £n}  ^y)  • Whenever 
the  second  probability  on  the  right  hand  side  of  (7)  is  small  compared 
to  the  first  probability,  A2(n)  will  be  about  equal  to  A*(n);  and  an 
appropriate  confidence  bound  based  on  the  sequential  test  will  be 
about  the  same  as  the  usual  confidence  bound.  This  is  presumably  the 
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case  unless  n is  quite  close  to  a + bt^^.  As  an  example,  consider  the 
first  sequential  test  described  In  Table  1,  for  which  a -t-  bt^^  “ 20, 
and  suppose  that  X(tj^)  - 17.  The  usual  80  percent  confidence  interval 
for  A would  be  [.50,  .945],  while  the  sequential  test  based  confidence 
Interval  Is  [^,A]  = [ .47, .92].  Although  the  usual  Interval  Is  based 
on  the  hypothesis  that  a fixed  length  test  was  being  used  and  is  not 
strictly  speaking  correct  under  the  present  conditions,  it  Is  probably 
accurate  enough  for  practical  purposes.  For  X(tj)  17  it  will  be 
even  more  accurate.  If  T ^ t^^,  there  is  no  reason  to  believe  that  the 
usual  confidence  interval  based  on  the  same  data  will  approximate  the 
interval  [^,A]  defined  in  (5)  and  (6). 

3.  Other  Sequential  Tests 

The  sequential  test  suggested  above  has  one  important 
disadvantage  vis  a vis  the  customary  fixed  length  test,  to  wit  its 
maximum  test  duration  is  greater.  One  can  argue  that  this  is  actually 
an  advantage,  because  the  maximum  test  time  is  attained  when  is 
accepted  and  accurate  estimation  of  A is  of  primary  importance. 
Nevertheless,  it  is  interesting  to  note  that  one  can  find  tests  simi- 
lar in  spirit  to  the  sequential  tests  of  Section  2 with  no  increase  in 
the  maximum  testing  time  over  the  usual  fixed  length  tests. 

Suppose  that  t^  and  m^  define  a fixeu  length  test  as  in 
Section  2 and  let  the  stopping  rule  T be  defined  by  (1)  with 
b “ - (l-Aj^)/log  Aq  as  before,  but  with  a to  be  determined.  Consider 
the  class  of  sequential  tests  which  stop  testing  at  mlnCT.tp)  and  for 
some  m*  < a + bt^  reject  Hq  if  and  only  if  T £ t^  or  T > t^  and 
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X(t^)  ^ m^.  The  Type  1 and  Type  II  error  probabilities  are  respec- 
t ively 


{T 


+ p,  {t 


> t 


0’ 


X(t„) 


-»  m 


‘n' 


and 


Pjd 


and  the  two  free  test  parameters,  a and  m*,  are  to  he  chosen  to  make 
these  error  probabilities  equal  to  the  desired  a and  6.  Approximate 
computation  of  these  probabilities  presents  essentially  the  same 
problems  as  the  determination  of  the  confidence  intervals  of  the 
preceding  section  and  may  be  handled  by  the  methods  of  the  Appendix. 
Unfortunately,  a trial  and  error  determination  of  a and  m^  is  a little 
more  complicated  than  determination  of  a and  t^^  in  Section  2. 
Nevertheless,  it  can  be  accomplished  fairlv  quicklv  by  starting  from 
the  values  of  a for  the  sequential  test  and  for  the  fixed  length 
test  in  Section  2 and  increasing  both  slightly  to  obtain  trial  values 
of  a and  m*. 

Corresponding  to  the  first  test  in  Table  1 (A^=l/2,  a=6=.l, 
and  tQ“18,9),  for  a = 3 and  m*  » 15  the  test  defined  above  has 
approximate  error  probabilities  oi  » .099  and  6 “ .109,  which  are 
probably  close  enough  to  their  nominal  values  for  practical  purncses. 
The  expected  testing  time  when  X - 1 is  about  9.5,  which  is  only 
slightly  larger  than  that  for  the  sequential  test  of  Section  2 and 
still  considerably  smaller  than  that  for  the  fixed  time  test. 
Computation  of  confidence  Intervals  for  this  test  is  exactly  the  same 
as  for  the  sequential  test  of  Section  2.  It  is  interesting  to  note 
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that  whenever  both  this  test  and  the  fixed  time  test  accept  (i.e., 

T > tp  and  X(tQ)<m^)  the  confidence  limits  for  the  sequential  test  are 
shifted  slightly  towards  smaller  values  of  A (larger  values  of  6)  than 
the  customary  intervals,  but  the  difference  is  probably  not  important 
for  practical  purposes. 

Until  now  It  has  been  assumed  that  the  desire  to  estimate  a 
accurately  when  is  true  is  of  primary  consideration  and  that  early 
termination  of  the  test  under  is  relatively  unimportant.  Hence, 
the  proposed  sequential  tests  have  been  designed  to  behave  like  a 
sequential  probability  ratio  test  under  and  like  a fixed  time  test 
under  Hq.  It  is  undoubtedly  possible  to  obtain  somewhat  earlier  ter- 
mination for  small  values  of  A without  an  appreciable  loss  of  estima- 
tion accuracy,  but  whether  the  benefits  are  wcrth  the  additional 
complication  remains  for  a future  study. 

One  possibility  is  to  Introduce  a lower  stopping  boundary 
-c  + bt,  so  that  testing  terminates  if  X(t)  ^ a + bt,  X(t)  £ - c + bt, 
or  t “ t2  for  some  suitably  chosen  a,  c,  and  t2.  This  stopping  rule 
is  similar  to  the  usual  (truncated)  sequential  probability  ratio  test. 
However,  by  choosing  c fairly  large,  one  does  not  reduce  the  sampling 
time  under  Hq  "too  much"  and  accurate  estimation  is  still  possible. 
Confidence  Intervals  may  be  defined  similarly  to  those  above,  and  it 
is  hoped  that  the  approximate  computational  methods  of  the  Appendix 
may  be  adapted  to  this  case  as  well. 
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Appendix 


The  following  Theorem  Is  the  theoretical  basis  for  (2)  and  the 
calculations  required  to  determine  (1  = 1,2),  It  Is  related  to 
Proposition  1 of  Slegmund  (1977).  (See  also  Woodroofe,  1976.)  The 
approximation  (3)  Is  based  on  a heuristic  argument  which  Is  given 
following  the  proof  of  Theorem  1.  An  approximation  to  the  expected 
sample  size  for  X > X'  Is  suggested  at  the  end  of  this  Appendix. 

Theorem  1 . Let  T be  defined  by  (1) . Let  m denote  the  least  Integer 
^ a + btj^.  Assume  that  a “ and  t^^  In  such  a way  that 

A « m - (a  + btj^)  remains  constant  and  for  some  X'  > b 

(8)  X ' t^  = a + bt 
Define  A"  < b by 

(9)  b - (X’  -X")/log(X7X")  . 

Then  for  each  X > 0,  k=  1,2 as  a 

a+bt^ 

P^{T<t^,X(tj)=m-k}  ~ (X'VX')  ^ exp{Xtj(X'/X"-l)}P^^,^^„{x(t^)»m-k}  . 

Proof . By  the  definition  of  conditional  probability 

(10)  Pj^{T<  t^,  X(t^)  -m-k}  - P^{T<  tj^lx(t^)  -m-k}P^{x(tj^) -m-k}  . 

It  follows  from  Lemmas  1 and  3 below  that  the  conditional  probability 

k-A 

in  (10)  converges  to  (X"/X')  as  a -♦■  <».  The  theorem  follows  by 
substitution  of  the  values  of  P^{X(tj)  ■ m - k) . 
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Lemma  1 . P^{T  < t |x(t  - m - k}  does  not  depend  on  A,  and  under  the 
conditions  of  Theorem  1 converges  to  P ,iX(t)£  -k  + A + bt  for  some 
t > 0}  as  a 

Proof . That  P^{T  < t ^ | X(t  » m - k}  does  not  depend  on  A is  an 
immediate  consequence  of  the  sufficiency  of  X(tj^)  . Hence,  it  suffices 
to  give  the  proof  for  some  particular  value  of  a.  Also  for  0 < r < t^^ 

P,  {X(t)>a-t-bt  for  some  t -r<t<t  |x(t  )=m-k}<P,{T<t  |x(t  )»m-k} 

A 1 JL  ii  '“Al‘1 

(11) 

£PA{Ti<tj^-r  |x(ti)“m-k}+PA{X(t^)^a+bt  for  some  tj^-r£t<t^  |x(tj^)*m-k}  . 
By  symmetry  the  first  probability  in  (11)  equals 

P,{X(t  )-X(t)<-k  + A + b(t  -t)  for  some  t -r<t<t  |x(t  )»m-k} 
A1  “ i 

= P^{X(t)£  -k  + A + bt  for  some  0<tj<r|x(tj^)*m-k} 

It  is  easy  to  see  by  direct  calculation  that  conditional  on 
X(tj^)  » m - k ~ A't^,  the  process  X(t) , 0 £ t £ converges  to  a 
Poisson  process  of  Intensity  A'.  Hence,  the  preceding  conditional 
probability  converges  to 

P,{X(t)£  - k + A + bt  for  some  0 < t £ r} 

Since  r is  arbitrary,  to  complete  the  proof  it  suffices  by  (11)  to 
show  that 

(12)  P^{T<  t^  - rlx(t^)  -m-k}  £ e(r)  , 

where  E(r)  does  not  depend  on  a (or  t^^)  and  converges  to  0 as  r -*•  «>. 
First  observe  that 
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P^{X(t^)=m-k}  •=  exp{  (X ' -A)tj^}(X/X')"’  ^ P^,^X(tj^)=m-k} 


and  by  the  local  limit  theorem  and  (R) 

P^,{X(t^)  = m - k}  ~ (2™)'^  . 

Hence,  to  prove  (12)  it  suffices  to  show  for  some  X > 0 

(13)  Pj^iT^tj^  ~ exp{(X'  - X)t^}(X/X')''’  m . 

The  proof  of  (13)  is  simplified  notationally  by  assuming  that 
m = a + btj^  and  taking  r to  be  such  that  br  = j is  an  Integer.  The 
general  case  requires  only  slight  changes.  Then 

P^{T£ti-r}  = P^{X(t)  2ia  + bt  for  some  t_<tj^-r} 

* P,{n>a  + bs  for  some  n<m-j} 

A n 

< I P.{s^<b"^(n-a)}  - I Pj^{X(b~^(n  - a))  >n} 
a^n<m-)  a£n£m-j 

- Z Z exp{(X'  - X)b"-^(n-a)}(X/X')^  Pj^,{X(b"^(n-a)  - 1}  . 

a<_n<m-j  i^n 

It  may  be  shown  for  all  t < t^^  and  1 ^ a — by  standard  large  deviation 
theory  for  t £ Gt^^  (Bahadur  and  Rao,  1960)  and  by  a local  limit 

-h 

theorem  for  et^^  £ t £ t^ — that  Pj^,{X(t)  “ l}  £ Cm  . Hence,  for  all 
X < X' 

P {T£t,-r}£C(l-X/X')  ^m  ^exp{ (X-X ' )b  ^a}  I [exp{(X'-X)b  ^}(X/X')] 
''  ^ a£n£m-,1 

- C(1-A/X’)“V^(X/A')"'"^ 

• exp{  (A-X  ' ) (-t  i+b  ) } Z,  [exp{(X’-X)b  }(X/X*)] 

a<n<m-j 
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By  (9),  for  A"  < A < A',  exp{(A'-A)b  ^}(A/A')  > 1 and  hence  the 
Indicated  sum  above  can  be  extended  as  a convergent  series  to  n • - 
Comparing  the  resulting  Inequality  with  (13)  and  recalling  that  ■)  • br 
completes  the  proof. 

The  following  lemmas  are  known,  but  for  lack  of  a convenient 
reference  and  for  completeness  their  proofs  are  sketched. 

Lemma  2 . Let  positive  numbers  and  T a stopping  rule  for 

X(t),  0 £ t <■  “>.  Then  for  arbitrary  t > 0 

(1^)  P,  it  < t}  = / expKp 

^^1  " {T<t}  2 ^ ^ ^ ^2 

Proof . Let  P^^^  denote  the  restriction  of  P^  to  the  space  of 

X(s),  0 £ s £ t,  and  let  Z(t)  - exp{  (m^  - Mj^)  t } (mj^/M2) be  the 

likelihood  ratio  of  P^^^  relative  to  P^*'^  Then 

hi  M2 

p {t  ^ t)  - y z(t)  dp 

^1  {f>t)  ^2 


Since  Z(t),  0 < t < “,  is  a P - martingale, 


1 - E [Zlmin(T,t))J  - / Z(T)dP  +/  Z(t)dP 

^2  {T<t}  ^2  {T>t}  ^2 


and  (14)  follows  by  subtraction. 
Lemma  3.  For  each  x > 0 and  A*  > b 


P^,{X(t)^  -x  + bt  for  some  t > 0}  - (A"/A')*  , 

where  A"  < b Is  defined  by  (9). 
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Proof.  Let  r - lnf{t:  X(t)  < -x  + bt},  and  observe  that  with 


probability  1 

(15)  X(t)  = - X + bt  on  {t  < “} 

Letting  t -*■  “o  in  (14)  and  appealing  to  (9)  and  (15)  yields 

P,,{t<oo}  = f exp{(X"-X*)T}(X’/V')^^'^^dP,„ 
^ {t<«}  ^ 


= (X’VX’)''  P^„{t<oo}  . 


Since  X"  < b,  Pj^„{t  < “>}  = 1,  which  completes  the  proof. 

Corollary  1.  For  X > X'  and  k = 1,2,...,  under  the  conditions  of 
Theorem  1 


(16) 


a+bt^ 

P^{T<t^,  X(tp<m-k}  ~ (X'VX')  ^ 

• exp{Xt^(X'/X"  - 1)  j^)  £ m - k} 


Proof.  Obviously  for  all  .1  > 0 

P^{T_<  ti,  m - k - J < X(tj^)  < m - k}  £ Pj^(T£tj^,  X(t^)  £m  - k} 

(17) 

£ P^fT£  tj^,  m-k-j<X(tj^)£m-k}  + P^{X(tj^)  £m  - k - j} 

For  fixed  j the  probability  on  the  left  and  the  first  probability  < 
the  right  of  (17)  may  be  evaluated  asymptotically  by  appealing  to 
Theorem  1.  The  second  term  on  the  right  hand  side  of  (17)  may  be 
shown  to  be  of  smaller  order  of  magnitude  for  large  1 by  standard 
large  deviation  arguments.  See  Bahadur  and  Rao  (1960)  or  Slegmund 
(1975b)  for  the  details  of  similar  arguments. 


Remarks . (1)  Corollary  1 may  be  used  to  evaluate  approximately  the 


probability  In  (2)  and  the  probabilities  appearing  in  the  definitions 
of  by  virtue  of  the  relation 

P^{T>tj^,  X(t^)<n}  - P^{x(tj^)<n}  - P^{T<tj^,  X(t^)<n}  . 

The  approximation  can  be  expected  to  yield  accurate  results  only  when 
n is  close  to  a + bt^^,  i.e.,  n = m - k for  a fairly  small  k,  and 
A > A'.  But  these  are  essentially  the  only  values  of  interest,  as  was 
observed  in  Section  2. 

(il)  A slightly  more  sophisticated  argument  similar  to  that  given  by 
Siegmund  (1977)  shows  that  (16)  holds  for  all  A > A",  A A ' . 

(ill)  It  is  tempting  to  evaluate  the  probability  appearing  in  the 
definition  of  re-writing  it  as 

P^{X(ti)>n}  + P^{T<t^,  X(t^)  <n} 

and  then  applying  Corollary  1.  However,  this  evaluation  is  of 
interest  for  small  A,  when  Corollary  1 is  not  applicable. 

Now  suppose  that  A^^  < A",  and  let  A^  > A'  be  defined  by 

(18)  V “ ^ ’ 

These  values  A^  and  A^  may  be  the  values  specified  by  the  test  of 
hypothesis  of  Section  2 but  need  not  be.  The  approximation  (3)  and  an 
approximate  evaluation  of  the  probabilities  appearing  in  the  defini- 
tions of  (1-1,2)  may  be  obtained  by  writing 

(19)  P,  {T<t,}  - P,  {T<«}  - P-  {t  <T<”} 

'^0  ^ ''o  ■'o  ^ 

and  giving  separate  approximations  for  the  two  terms  on  the  right  hand 


16 


side  of  (19).  Letting  t ® in  Leinina  2 (note  that  P.  {!<“’}  * 1)  and 

'^1 

appealing  to  (18)  gives  the  representations 

and 

(20)  P,  (t  <T<<»}  - (X_/X,)®  / E.  {(X  /X  )’^^'^^"®"^'^|x(t  )}dP  . 

^0  ^ ^ {T>t^}  \ 0 1 1 ^1 

The  limiting  value  of  {(X^/A^)  } as  a -♦  ® is  given  in 

Lemma  A below  leading  to  the  asymptotic  relation 

(21)  P^  {T  < »}  ~ {(b  - Xp)/(Xj  - b)}(XQ/Xj^)®  as  a ->  <»  . 

The  Integral  in  (20)  may  be  re-written  as 

m X(T  )-k+A-bT 

(22)  I P-  {T  >t-,  X(t.)  -m-k}  E {(X  /X  ) ^ } , 

k.i  X^  a 1 1 A^  0 1 

where  T - inf{t:  t >0,  X(t)  >x  + bt}  and  A = m - (a  + bt  ) as  before. 

To  obtain  a simple  approximation  to  (22)  , one  might  replace  the 

expectations  there  by  their  limits  as  k or  one  might  replace  all 

these  expectations  by  that  for  T^,  which  is  also  given  in  Lemma  4. 

The  latter  alternative  seems  more  attractive  for  two  reasons: 

(a)  the  values  of  P.  {T  > t , X(t,)-m-k}  are  larger  for  smaller 

A 1 i 

values  of  k,  and  (b)  using  k - 0 rather  than  k infinitely  large  gives 
a smaller  approximation  to  (22)  and  hence  a larger  (more  conservative) 
approximation  to  Replacing  the  in  (22)  leads 

by  Lemma  4 below  to  the  approximation 
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^0 


^<T<oo}  i {T  > t^}(A^/A^)®  . 


Substituting  this  result  and  (21)  into  (19)  gives 

Px  [(b-A^)/(A^-b)  - AQb"^P^^{T>t^}]  . 


which  is  (3)  in  the  special  case  Aj^  - 1. 


Lemma  4 . For  A^  and  A^^  defined  by  (18) 


lim  E,  {(X^/X^) 
a-»“  ''l 


X(T  )-a-bT 


(b  - A^)/(A^  -b) 


and 


X(T  )-bT 

Ea^{(X^/A^)  - X„/b 


Also 


Proof.  Let  T - lnf{n:  n - bs  > a} , so  X(T  ) • T and  T ’ s • 

a n — a a “a 

let  T • lnf{n:  n-bs^<0}.  By  Lemma  2 and  random  walk  theory  (Feller, 
1966,  Chapter  XII) 

X(T-)-bT- 

Ev  {(X„/X,)  ^ - P,  {!„<«>}  - 1-P, 


'A^^'  0'  I' 


Aq-o 


1 - 1/E^  T_  - 1 - (1  - bA"^)/E^  (t_  - bs^  ) - 1 + (I  - bAQ'')/bAQ"’  - A^/b  . 


^0  " 


-1.  ,-l 


By  considering  the  renewal  process  defined  by  - bs^  , the  renewal 

theorem  gives  the  P,  limiting  distribution  of  - bs^  “ ~ 

''l  a 

as  a -*•  « (Feller,  1966,  Chapter  XI).  Combined  with  (18)  and  random 

walk  theory  (Feller,  1966,  Chapter  XII),  this  leads  to 
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X(T  )-a-bT 
lim  E {(A  /X  ) ^ ^ 

a-*«>  1 


} ” lim  E.  exp{-  b (A  - A„) (t  - bs  )} 
^ A i 1}  a T 

a-«o  1 a 


{E.  (T- - bs  ) } ^ Jl  exp(-b  ^(A  -A  )x}P,  - bs  > x}dx 

Ai  U Tg  U 1 0 0 Tg 


{(i-b/»j)E  T„r'  b(>j-x„)->  p (T„..) 


b(Ai  - AgA'^l  - b/Ai)~\EA  T_)"^  {!_  = «>} 


b(A^  - Ag)“^l  - b/A^)'^l  - Ag/b)  (1  - Ag/A^) 


(b- Ag)/(A^-b)  . 


There  remains  the  task  of  comnuting  approximations  to 
Ep^{min(T,  t } , especially  for  A ^ 1.  With  the  help  of  Theorem  1,  this 
becomes  an  easy  matter.  It  is  easy  to  see  that  for  A > b 

(23)  Ejmin(T,t,)}  - E.(T)  - / E.  {T  - t Jx(t, ) }dP,  . 

A 1 A , A 1 1 A 


The  usual  Wald  approximation  to  E^(T)  obtained  by  using  Wald's 
identity  and  ignoring  the  excess  X(T)  - (a  + bT)  is 


E^(T)  S a/(A-b)  . 


The  same  argument  gives  the  approximation 


Ej^{T- tjx(t^)  -m-k)  = (k-A)/(A-b) 


Hence  the  second  term  on  the  right  hand  side  of  (23)  may  be  re-written 


Z Ej^{T-  tj|X(tj)  - m-k}[Pj^{X(tj)  - m-k}  - P^{T_<  t^^,  X(tj)  -m-k}] 
k*l 
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and  evaluated  approximately  with  the  help  of  (25)  and  Theorem  1 to 
obtain 

f EJT-  t,  |x(t,)}dP,  S (X-b)~^[(a  + bt,)P,{T>  t,} 

{T>t^}  A 1 1 A 1 A 1 

(26) 

-At,  Ps{s  ,>t  }+(A"/A')"’  ^ At  exp{At  (A'/A"-1)}P,-  , ,,,,{8  }. 

j.  A m-1  1 i 1 aa  /A  m-i  1 

Substituting  (24)  and  (26)  Into  (23)  gives  an  approximation  to 
E^{mln(T,  t j^) } . It  should  be  fairly  accurate  at  least  whenever  A > A', 
so  Pp^{T  > Is  small  and  the  second  term  on  the  right  hand  side  of 
(23)  Is  small  compared  with  the  first.  It  Is  possible  to  approximate 
the  expected  excess  over  the  boundary  E^{X(T)  - a - bT} , and  hence  give 
a slightly  more  accurate  approximation.  However,  the  Increase  in 
accuracy  Is  rather  modest  in  contrast  to  the  problem  of  approximating 
error  probabilities,  where  the  excess  over  the  boundary  Is  more 
important.  (See  Slegmund,  1975a.) 
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